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Let {Xj} be independent, identically distributed random variables. It is well known that the 
functional CUSUM statistic and its randomly permuted version both converge weakly to a 
Brownian bridge if second moments exist. Surprisingly, an infinite- variance counterpart does 
not hold true. In the present paper, we let {Xj} be in the domain of attraction of a strictly 
a-stable law, a £ (0,2). While the functional CUSUM statistics itself converges to an a-stable 
bridge and so does the permuted version, provided both the {Xj} and the permutation are 
random, the situation turns out to be more delicate if a realization of the {Xj} is fixed and 
randomness is restricted to the permutation. Here, the conditional distribution function of the 
permuted CUSUM statistics converges in probability to a random and nondegenerate limit. 
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1. Introduction 

Let X, Xi, . . . , Xn, ... be independent, identically distributed random variables. CUSUM- 
based procedures, frequently used to test for time homogeneity of an underlying random 
phenomenon, are functionals of the process 

1 

Z„(i) = Y,{x,-X^), t€[0,l], (1.1) 

.7 = 1 



where [-J denotes integer part and 

^ n ^ n 
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are the sample mean and sample variance, respectively. The asymptotic properties of 
{Zn{t)} are immediate consequences of Donsker's invariancc principle (see Billingsley 

(1968)). Denote by convergence in the space I?[0, 1] of cadlag functions equipped 

with the Skorokhod Ji-topology. We state the following fundamental theorem. 

Theorem 1.1. If EX^ <oo, then 

Z„(t)''^"s(t) (n^oo), 

where {B{t):t^ [Oil]} "is a Brownian bridge. 

One of the main problems in testing for a homogeneous data generating process is 
that of obtaining approximations for the critical values. It is well known, however, that 
the convergence of functionals of Z„(t) to their limit distributions is often quite slow 
(sometimes even the convergence speed is unknown), raising the question of whether 
Theorem 1.1 is reasonably applicable in the case of small sample sizes. To avoid these 
complications, along with bootstrap methods, the permutation principle has been sug- 
gested to simulate critical values. For a recent, comprehensive survey of this topic, we 
refer to Huskova (2004). Let tt = (7r(l), . . . , 7r(n)) be a random permutation of (1, ... , n) 
which is independent of X = {Xi,X2, ■ ■ ■)■ The permuted version of Zn{t) is then defined 

by 

1 

z„.,(t) = — J2ix.u)-^r.), te[o,i]. (1.2) 

J = l 

One can think of Zn,Tr{t) as a CUSUM process whose summands are chosen from 
Xi, . . . ,Xn by drawing from a box without replacement. The following result establishes 
the limiting behavior of Zn^Trit) and hence shows that the permutation method works to 
simulate critical values. Also, note that empirical evidence suggests that the convergence 
to the limit is faster than for Zn{t). 

Theorem 1.2. IfEX^ < oo, then, for almost all realizations of X, 

Zn^^{t)^^^ B{t) (n->oo), 
where {B{t) :t G [0, 1]} is a Brownian bridge. 

Theorem 1.2 states that, for almost all realizations of the data, the permutation method 
provides the asymptotically correct critical values. A proof can be found in Billingsley 
(1968), pages 209-214. 

In this paper we are interested in the asymptotics of the analogues of Zn{t) and Z„ .^(i) 
in the infinite- variance case EX^ = oo. To this end, let a S (0, 2] and recall that a random 
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variable S,a is strictly a-stable if its characteristic function has the form 

exp(-ciV2), if a = 2, 

(/>a(i) = "( cxp(-c|i|" l-i/3sgn(t)tan( ) ), if a e (0, 1) U (1, 2), /3 e [-1, 1], 



l-i/3sgn(t)tan|^-Q;j j 
exp(— c|i|), if a = 1, 

for some c > 0. This definition includes the normal law (a = 2) and the Cauchy law 
{a = 1), where the latter is moreover assumed to be symmetric. Note that E[^q] exists 
only for a € (1,2] and E[^^] only for a = 2. Since scaling the random variables X„ does 
not change the normalized partial sum processes in (1.5) and (1.6) below, for our purposes 
it will suffice to consider the case c ~ 1 . The class of stable distributions has become more 
and more important in theory as well as in applications. Stable laws appear in a natural 
way in areas such as radio engineering, electronics, biology and economics (sec Zolotarev 
(1986), Chapter 1). For other expositions on a-stable random variables and processes, 
we refer to Samorodnitsky and Taqqu (1994) and Bingham et al. (1987). 

In what follows, let a £ (0, 2) and consider independent, identically distributed random 
variables {Xj} which are in the domain of attraction of a strictly a-stable law. In the 
case a 1, this is equivalent to saying that there is a function Lix), slowly varying at 
infinity, such that 

1 " -D 

rmXl(^J"^") — (n~>oo), (1.3) 



n 



j= 



where is a strictly a-stable random variable and /i^ = if a S (0, 1). We say that L is 
slowly varying at infinity if limt_+oo L{ct) / L{t) — 1 for all c > 0. In the case a = 1, we will 
assume (1.3) with = 0, excluding nonlinear centering sequences which would prevent 
the weak convergence of the process An{t) in (1.5) below. If (1.3) holds, then there is a 
p S [0, 1] such that the tail probabilities of X and \X\ satisfy the relations 

hm T^V and hm T = 9' (1-4) 

where g = 1 — p and /3 = 2p — 1; see Feller (1966) and Petrov (1995) for details. 

To define the counterparts of Z„(t) and Zn^-nit) in the infinite- variance case, introduce 
the process 

\nt\ 



'(*) = ^E(^^--^")' *^[0,1], (1.5) 

and its permuted version 



J = l 



1 

A.,.(<) = ;p5^(x.o-)-X0, ie[0,i], (1.6) 



Tn 
3 = 
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where T„ = maxj<„ \Xj \ and tt = (7r(l), . . . , 7r(n)) is a random permutation of (1, . . . , n) , 
independent of X. In contrast to the finite-variance case, Tn is a natural norming factor 
in (1.5) and (1.6) since ~ fJ'a)/Tn has a nondegenerate Umit distribution. 

One might now expect {An{t)} and {A„_^(t)} to foUow an asymptotic pattern similar 
to that of {Zn(t)} and {Z„ .^.(t)}. Consequently, given a realization of X, one might want 
to use the permutation principle to simulate critical values that have a higher accuracy 
in the case of small sample sizes. Surprisingly, this turns out to be impossible. While a 
version of Theorem 1.1 holds true for {An{t)}, an adaptation of Theorem 1.2 cannot be 
given for almost all realizations of X. On the contrary, we will show that, conditioned on 
X, the distribution function of the permuted process {^n.7r(i)} converges to a random 
and nondegenerate limit for every fixed t. On the other hand, there is an averaging effect: 
if both X and tt arc assumed to be random, then A„,7r(i) and An{t) converge weakly to 
the same limit, namely to an a-stable bridge. 

The paper is organized as follows. In Section 2, we will precisely formulate our results. 
Their proofs will be given in Section 3. 



2. Results 

First, we study the limiting behavior for the sequence {An{t) :t E [0,1]}. Its weak con- 
vergence can be derived from the joint convergence of 



f 1 1 T 

|;^T7^E(^.-M.Me[0,l]| and 



To deal with these two sequences, we are going to apply the method developed in LePage 
et al. (1981), where it was proven that any stable distribution can be represented as an 
infinite sum of random variables constructed from partial sums of exponential random 
variables. More specifically, let {Ej} be a sequence of independent, identically distributed 
exponential random variables having expected value 1 and define the sequence {Zj} by 



Z, = iEi + --- + Ej)-'/'', j>l. 



(2.1) 



Additionally, let {Sj} be independent, identically distributed random variables, indepen- 
dent of {Ej}, satisfying P{Sj = 1} = p and P{6j = —1} = q, with p and q specified in 
(1.4). Then, define 



G(0,1], 



fe=i 



Y^iSkZk -ip- qMZkHO <Zk< 1}]), a e (1,2). 
I. fc=l 



(2.2) 
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LePage et al. (1981), Theorem 1, showed that the sums in (2.2) converge with probabihty 
one and 

77 = ^q/ci with some constant ci- (2-3) 

Consider a random vector {Wa{t)^Z) such that Wait) is a strictly a-stable process, 
Z = Zi and the joint distribution of {Wait), Z) is defined by the requirement that for 
any = ti<---<t/f = l, wc have 

{Wa{t2) - Wa{tl), Waits) -Wa{t2),..., Wa{tK) - Wa{tK-l),Z) 

= f(t2-ti)'/"r7i,(i3-t2)'/"?/2,...,(tK-tK-i)'/"?/K-i, max (t^+i - t^f/^Z, V 

V l<j<K-l J 

where (771, Zi), . . . , (ry^-i, ^i^-^i) are independent, identicaUy distributed random vec- 
tors, distributed as (77, Z). The following theorem is essentially known; see Kasahara and 
Watanabe (1986), Section 9. 

Theorem 2.1. If (1.3) holds, then 

where L\(x) ~ c\L{x) with c\ given in (2.3). The distribution of the vector {Wa(t),Z) is 
defined above. 

The asymptotic behavior of {An{t)} is now an immediate consequence of Theorem 2.1 
and the continuous mapping theorem. 

Corollary 2.1. // (1.3) holds, then 

Ar,{t)^-H^ ^Ba{t) (n^oo), 
where, forte [0,1], Ba{t) ^Wa{t) - tWa{l). 

The process {Ba{t) :t e [0,1]} is sometimes called an a-stable bridge. Very little is 
known about the distributions of functionals of Ba (t) / Z and therefore it is hard to 
determine critical values needed to construct asymptotic test procedures. It would hence 
be beneficial to apply the permutation method to obtain critical values for functionals of 
An{t). However, as the subsequent series of theorems shows. Theorem 1.2 does not have 
an infinite- variance counterpart. 

Consider the process {An,Tr{t)} defined in (1.6) and let both X and tt be random. We 
then obtain the following result. 
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Theorem 2.2. If (1.3) holds, then 

AnAt) ""^^ l^a(i) {n ^ oo), (2.4) 
where, for t € [0, 1], Ba{t) = Wa{t) - tWa{l). 

Obviously, Theorem 2.2 is much weaker than Theorem 1.2 since it is only valid for 
the average of the realizations. However, a stronger result, holding true for almost all 
realizations of X, cannot be proved. Let Px and Ex denote conditional probability and 
expected value given X, respectively. 

In order to state the main result of our paper, we introduce some further notation. 
Let t G (0, 1) and, on some probabihty space, consider sequences {Sj : j > 1}, {S* : j > 
1}, {Sj{t):j > 1}, {5*{t):j > 1} such that these sequences are mutually independent, 
{Sj ■j> 1}, {S* :j> 1} arc partial sums of independent exponential random variables 
with parameter 1 and {Sj{t) ■.j> 1}, {<5*(<) - j > 1} are both sequences of independent 
random variables taking the values 1 and with probabilities t and 1 — t, respectively. 
Let S be the cr-algcbra generated by {Sj, S* :j > 1}. 



Theorem 2.3. Lette (0,1). // (1.3) holds, then 



P^{An.At)<x}^Ps{R{t)<x} (n^c5o) 



for any real x, where 



oo ^ oo ^ 

=1 1=1 ^"^J > 



3 = ^ ] 

with wi = q^l"' , Wi =p^/", where p and q are defined by (1.4) 



M = max(^,-^L (2.5) 

Theorem 2.3 immediately implies that /'x{^n.7r(i) < x} cannot converge to P{Ba{t) / Z < 
x} with probability one. Note that Theorem 2.3 is the permutation analogue of Athreya 
(1987), which showed that the conditional distribution of the appropriately normalized 
bootstrap sample mean converges in distribution to a nondcgencratc random variable. 
The limits in Athreya (1987) and Theorem 2.3 are different due to the sampling with 
replacement in the bootstrap case and without replacement in the permutation case. 

Theorem 2.3 describes the limiting conditional distribution of An,Tr{t) for any fixed 
t. Its proof can be modified to yield the asymptotic conditional distribution of vectors 
{An^Tr{ti), . . ., An,Tritr)) for any choices of < ti < • • • < < 1- To do so, we must extend 
the definition of the sequences {Sj{t)} and {S*{t)}. Let {Uj} and {U*} be independent. 
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identically distributed random variables, uniform on [0, 1] , which are independent of {Sj} 
and {5*}, and let 

Sj{t)=I{Uj<t} and 5*{t)=I{U* <t} (j > 1). (2.6) 

Therein, I{A} is the indicator function of a set A. Note that for a single t, this definition 
coincides with the definition in terms of Bernoulli variables given above. The latter, 
however, do not carry any information on the joint behavior for a collection ti,. . . ,tr. 
We arrive at the following theorem. 



Theorem 2.4. Let <ti < ■ ■ ■ <tr < I. If (1-3) holds, then, as n — > oo, 

Px{^„,^(tl) <Xu.- .,A„^^{tr) < Xr} ^ Ps{i?(tl) < Xi, . . . , < X^} 

for any real xi, . . . ,Xr, where R{t) is defined in Theorem 2.3 with the Sj{t),6*(t) from 
(2.6). 



The proof of Theorem 2.3 will show that An,-K{t) depends only on the very large and 
very small order statistics. These, however, are asymptotically independent, explaining 
why the infinite sums defining R{t) in Theorems 2.3 and 2.4 are independent. In addition, 
5j it) is the limit of an indicator variable which determines whether or not the j th smallest 
order statistic is among the first \ nt\ permuted observations. The same reasoning applies 
to 5*{t) and the location of the jth largest order statistic in the permutation tt. 

The previous results concern the asymptotic properties of {An(t)} and {A„_7r(0}j but 
it is possible to consider modifications of these processes which involve replacing the 
normalization T„ by a more general sequence 

/ „ \ 1/- 

T^^^ =\^\Xj~ X,,\'' \ with some 1/ > a. 

The corresponding CUSUM processes are then defined by 

L"*J _ L"tJ 

A^:\t)^—Y,{x,-x^), A^:}^{t) = — Y,{x^u)~Xn), te[o,i]. 

Analogues of Theorems 2.1 and 2.2 can easily be established by exploiting the joint 
convergence of the partial sum processes X]|=i Xj and X]|=i l^jT- Theorems 2.3 and 
2.4 also remain true (with some modifications in the corresponding limit processes) so 
that, conditionally on X, the permuted sequence {An^it)} cannot converge weakly in 
2?[0,1]. 
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Proof of Theorem 2.2. Note that, by the assumptions on {Xj}, 

{A„(i):te [0,l]} = {A„,,(<):tG [0,1]}, 
so the result follows from Corollary 2.1. □ 

From now on, we fix a realization of X. Permuting the X's is equivalent to selecting 
n elements from Xi,X2, ■ ■ - jXn without replacement. The proof of Theorem 2.3 will be 
based on the order statistics Xi^n < • • • < Xn.n of Xi, . . . ,X„. Our first goal is therefore 
to express A„^Tr{t) in terms of Xi_„, . . . , X„^n- To do so, let 

(n),,x _ J 1, if Xj,n is among the first \nt\ elements chosen, 
^ [0, otherwise, 

that is, the sequence {s'f'\t)} identifies those of the order statistics which are selected 
by the permutation tt in the first \nt\ positions. If there are identical observations, then 
we add multiples of l/n^+^/" to the Xj^^s to break the ties. Since this procedure will 
not change the asymptotics, from now on, we assume, without loss of generality, that all 
observations are different. It is then easy to sec that 

Ln*J n n 

where e'"J^\t) = e'""\t) — Exe^"'(i) = £'j^\'t) — lnt\/n is the centered version of e^"^(t). 

The proof of Theorem 2.3 will be the consequence of a series of lemmas to be stated 
next. Since {Xj} is a sequence of random variables in the domain of attraction of a 
strictly a-stable random variable with a e (0,2), only the very small and very large 
order statistics will contribute asymptotically to A„^7r(i), which is shown in Lemmas 3.1 
and 3.3. 

Let Varx denote conditional variance with respect to X. 



Lemma 3.1. If (1.3) holds, then 



K 



lim limsupP< Pxn — t 



/"L(ri) 



n-K 
j=K+l 



for all s > and 6 > 0. 
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Proof. Observe that the statement of our theorems does not change if we replace Xj by 
Xj — c and thus we can assume that /i„ = for all a e (0, 2). Clearly Exej"-" (t) = and 



{n)f,..2^ _ lnt\ flnt\ 



Ex[(eT^(0)1 



j = l,...,n, 



and, for j ^ k, 

^ ^;.(«)^^^^(»)/^M _ [nt\{[nt] - 1) f [nt\Y _ [nt\ (n ~ [' 

J^X e, (t [t \ — -, -T — T7 

■' n[n — 1) \ n J n''{n—\ 



1) ■ 



(3.1) 



(3.2) 



Further we have 



and 



n-K 

{X,,,,-X^)ef{t) 



Varx {X,.^n~X„)ef{t) 



n-K 



= Y (x„„-x„)(x,.„-x„)E[4")(t)4")(i)] 

j,k=K+l 



-K 



\nt\ n - [nt\ , ^ ,2 , 1 



n n 



j=K+l 



n-l 



n-K 

^ ^ {Xj^n ~ Xn){Xk.n ~ Xn, 
j,k=K+l,k^j 

2 

2 



n-K ^ / n-K \ n-K 

i=A:+i \i=A'+i / j=K+i 

n-K / n-K 

<2 Y iXj,n^Xnr + ^i E 



Now, 



n-K n-K 
j=K+l J=K+1 



n-K 



Using (1.3) with /i^ = 0, wc obtain 



nX^ 
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As a consequence of Theorem 4.1 in Csorgo et al. (1986), we obtain that, for aU K > 1, 



1 



ii/"L(n) 



j=K+l 



:Op(l) 



as n — > cx). Therefore, 

n-K 



1 



n 



n 



\Xn\ 



j=K+l 



1 " 



op(l). 



Clearly, the random variables Xj belong to the domain of attraction of a stable law with 
parameter a/2, with norming factor n'^^"L'^{n) and centering factor 0. Hence, Corollary 
3.1, Theorem 4.1 and Proposition A. 3 of Csorgo et al. (1986) imply that 



n-K 
j=K+l 



where 



OO ^ OO - 



j=K+l '^j 



j=K+ 



i(^;p/«' 



Clearly, A{K) a.s. as K ~> oo. Another application of Theorem 4.1 in Csorgo et al. 
(1986) yields that, for any K >1 and oo. 



1 



1 



n-K 



E i^3,n-X„ 



\j=K+l 

The assertion of Lemma 3.1 is now obtained from Markov's inequality. 



□ 



Without loss of generality, we henceforth assume that all processes used in this paper 
are defined on the same probability space. In the following, we shall utilize a result 
of Berkes and Philipp (1979) to show that, on the remaining index range j S [0,K] U 
[n — K + l,n], the dependent random variables {£^j^\t)} can be approximated with the 
sequence of independent Bernoulli variables {Sj"\t)} introduced above. 

Lemma 3.2. // (1.3) holds, then, for each n and each t G (0, 1), there exist independent, 
identically distributed random variables (5^"^ (t), j ~ I, . . . ,n, independent of {Xj}, with 



P{A(")(i)^l}^M and P{s\-\t)^0}^^^^^ 



(3.3) 
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such that 

( K 



- ^n)(4''(0 - ^ U ^ (3.4) 



Px E {X,.n-X,,){ef~>(t)~6f{t))M<^^ (3.5) 



for all K=l,...,[n/2\. 



Note that relations (3.4) and (3.5) arc obvious for K > ^ n/48, but we will use the 
lemma for constant K . 

Proof of Lemma 3.2. For j > 1, let 72j-i = £j"''(i) and 72j = ^n-j+i(i)- To re- 
place the dependent s'f^it') with the independent (5j"'(i) given in (3.3), we need to 
derive an upper bound for the difference between the conditional probability P\^k = 
afc|7fc_.i = afc_i,...,7i = ai} and the probability P{^k = To do so, consider a 
set A = {xi, . . . , a;„} and choose from it a subset of \rit\ elements. The probability 
that this subset contains r fixed elements of A but docs not contain another fixed 
s elements of A is p["i(i) = ("~i'|'Z^)/(L^tj) ■ Provided that fc = r + s, it holds that 
P{7i = fli, . . . ,7fc = flfc} = pr^] (t), where r of the coefficients arc equal to 1 and s 
are equal to 0. Similarly, P{7i ~ ai, . . . ,7^ = 0^,7^+1 = 1} =Pr]^i s{t). Consequently, 



P{7fc+i = l|7i=ai,...,7fc=:afc}- - 



r 



Since it can be assumed that 1 < k <n/2, we can estimate 



n — r — s 



\nt\ — r ^ 



n — r — s 



^l + r + s_ 1 + fc -^ + ^Yi < 4^ 

~ n — r — s n{\ — k/n) n \ n J ~ n 



In a similar fashion, we can obtain 

|P{7.+i = l}-t|<-. 

n 

Thus, for flfc+i = 1 (and consequently for ak+i = 0), we have 

8k 

|P{7fc+i = afc+i|7fc =afe,. . . ,71 = ai} - P{7fc+i ^ak+i}\ < — 

n 
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for all A; = 2, . . . , n. Hence, applying Theorem 2 of Berkes and Philipp (1979), there exist 
independent Bernoulli random variables 6j"'\t), j = 1, . . . ,n, satisfying (3.3) such that 

p{i4"'(«)-4"'wi>^^}<f 

and 

^{iew.w-e'.««)i>f }<^5^ 

for fc = 1, . . . , [72/2] . Since the variables e^"''(t) and (5j"''(t) take only the values and 1, 
the last two formulas imply that, with the exception of a set of probability not exceeding 
48A'Vn, all differences £^"^(t) - (5]"^(t) in the sum in (3.4), and similarly in the sum in 
(3.5), are equal to 0. □ 

The following lemma is the counterpart of Lemma 3.1, in which the e^"'\t) are replaced 
by mean-corrected variables (5^"' (t) . 

Lemma 3.3. // (1.3) holds, then 



lim lim sup P < Px ' 



1 



{X,,^-X^)5f{t) 

j=K+l 



for alle>0 and S > 0, where 6^"\t) = (5j"^(i) - [nt\/n. 

Proof. The assertion follows along the lines of the proof of Lemma 3.1. □ 

Let Sj^n = iXj,n — Xn)/Tn dcnotc the standardized extreme order statistics. The joint 
weak convergence of the Sj^n, j G [1, K]U [n — K + 1, n], is given in the following lemma. 
Recall from Section 2 that {Sj : j > 1} and {5* : j > 1} are sums of independent sequences 
consisting of independent exponential random variables with parameter 1 . 

Lemma 3.4. // (1.3) holds, then, as n^oo, 



(5,-„:je[l,X]U[n-/l+l,n]) 



where wi =q^^°', W2 — "p^l'^ and M is the random variable defined in (2.5). 
Proof. Csorgo et al. (1986), page 110, showed that 

U^.f A Xj,n ■.je[l,K]U[n-K + l,n]) 
n'-'°'L[n) 
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Since, by (1.3), X„/T„ and, clearly, Tn = niax{|Xi_„|, |X„.„|}, Lemma 3.4 is 
proved. □ 

Proof of Theorem 2.3. In view of Lemma 3.1, we have 

(1 " 

jell,K]U[7i-K+l,n] / 

p 

where B{K) ^0 as if— > oo. Here, distx denotes conditional distribution with respect 
to X and C is the Levy distance. We used here the fact that if, for two random variables 
^ and 77, we have P{\£, — 'n\>e) <e, then the Levy distance of the distributions of ^ and 
77 is not greater than e. By Lemma 3.3, the previous relation remains valid if we replace 
ef^ {t) by jj"^ (t) . Further, ef^ (t) - {t) = ef'^ (t) - (jj"' (t) and thus Lemma 3.2 imphes 
that for any fixed A', the Levy distance of the conditional distributions 

^ ' je[l,-R']u[n-A-+l,n] 

and 

tends to in probability as n 00. Since Tn/{n^/"L{n)) has a non-dcgencratc limit 
distribution, the above statements remain valid if wc replace the norming factor n^^°'L{n) 
by T„. Thus, it suffices to consider the limiting behavior of 



distx^l (X,,„-X„)5j")(0) =distx( S,jf\t) 



for fixed K. By the Skorokhod-Dudley-Wichura representation theorem (see, e.g., 
Shorack and Wellner (1986), page 47), on a sufficiently large probability space, one can 
redefine the vectors {Sj^n'j S [Ij^] U [n — K + l,n]) and the independent sequences 
{Sj :j> 1}, {S* : j > 1} such that the convergence relation in Lemma 3.4 holds almost 
surely. Since the Levy distance of the distribution of two sums 

Y c,-Sl"\t) and Y 4?"V) 

je[l,K]U[n-K+l,n] je[l,K]u[n-K+l,n] 
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is not greater than X]jG[i K]uln-K+i n] I'^i ~ '^'j I '^^^^ sequences {cj}, {c^}, it follows 

that for the redefined variables Sj^n, Sj, S* , we have 



rfdists 

V jell,K]u[n-K+l,n] 



dists- 

as n — ^ oo. Clearly, this redefinition will change the random distribution 



dist 



j<^[l,K]Vj[n-K+l,n] 



(as it will be defined on a new probability space), but not its distribution. Hence, it 
suffices to show that the Levy distance of the conditional distributions 



distc 



and 



dists 



M 



-1 E ^ ('^. (^) - + -2 E (<5* it) t) 



5 = 1 



(3.6) 



(3.7) 



tends to a.s. for any fixed K >1 and that the conditional distribution in (3.7) converges 
a.s. to the same expression with A' = oo. The first statement is obvious from the fact 
that (5j"'(i) = 5j{t) — \ nt\/n and the second statement follows from the fact that, by the 
strong law of large numbers, we have Sj/ j — *■ 1 a.s. and thus 



S. 



whence it follows that the series 



Vars(-i^(5,(t)-t)l=0(r'/") 



OO -J oo ^ 



.1 •S'j 



are, conditionally on S, a.s. convergent by the Kolmogorov two series theorem. Note, 
finally, that, by a theorem of Levy (1931), page 150 (see also Breiman (1968), page 51, 
Problem 16), the distribution 



dists ^ ( E (^j- (i) - i) + ^2 £ 
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is a.s. continuous. Since weak convergence of (ordinary) distributions to a continuous limit 
implies the pointwise convergence of the corresponding distribution functions, Theorem 
2.3 follows. □ 



The proof of Theorem 2.4 requires a simple modification of Lemma 3.2. 

Lemma 3.5. // (1-3) holds, then, for each n and each choice of < ti < ■ ■ ■ < tr < 1 , 
there exist independent, identically distributed random vectors iSj"'\ti), . . . ,6'^^\tr)), j = 
1, . . . ,n, independent of {Xj}, such that 



(5(")(ii),...,4"^(t.))=(/{c/ 



< 



[ntil 



IlU < 



\ntr\ 



where U denotes a uniform random variable on [0, 1] and, further, for all 5 > Q, 

K 



1 



Px { max , , ^ , , 



J2(X,,^-X^){ef{t,)-6p{t,)) 



>6 







and 



Px.\ max —r-, -— 

I !<£<»■ ni/"L(n) 



J2 (X,,,-X,,)(sf\t,)^5f\t,)) 

j=n-K+l 



>5 



Proof. The assertion of Lemma 3.5 follows by applying the approximation procedure in 



the proof of Lemma 3.2 to the vector (e^"^(ti), . . . ,e'^^'{tr)) instead of £^-^'{t). Since the 
changes arc routine, we omit the details. □ 



Proof of Theorem 2.4. The proof can be given by repeating the arguments developed 
in the proof of Theorem 2.3, replacing Lemma 3.2 with Lemma 3.5. □ 
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